One-Shot Object Affordance Detection in the Wild

نویسندگان

چکیده

Affordance detection refers to identifying the potential action possibilities of objects in an image, which is a crucial ability for robot perception and manipulation. To empower robots with this unseen scenarios, we first study challenging one-shot affordance problem paper, i.e., given support image that depicts purpose, all scene common should be detected. end, devise One-Shot Detection Network (OSAD-Net) firstly estimates human purpose then transfers it help detect from candidate images. Through collaboration learning, OSAD-Net can capture characteristics between having same underlying learn good adaptation capability perceiving affordances. Besides, build large-scale purpose-driven dataset v2 (PADv2) by collecting labeling 30k images 39 103 object categories. With complex scenes rich annotations, our PADv2 used as test bed benchmark methods may also facilitate downstream vision tasks, such understanding, recognition, Specifically, conducted comprehensive experiments on including 11 advanced models several related research fields. Experimental results demonstrate superiority model over previous representative ones terms both objective metrics visual quality. The suite available at https://github.com/lhc1224/OSAD_Net .

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Few-shot Object Detection

In this paper, we study object detection using a large pool of unlabeled images and only a few labeled images per category, named “few-shot object detection”. The key challenge consists in generating trustworthy training samples as many as possible from the pool. Using few training examples as seeds, our method iterates between model training and high-confidence sample selection. In training, e...

متن کامل

Object-object interaction affordance learning

This paper presents a novel object–object affordance learning approach that enables intelligent robots to learn the interactive functionalities of objects from human demonstrations in everyday environments. Instead of considering a single object, we model the interactive motions between paired objects in a human–object–objectway. The innate interaction-affordance knowledge of the paired objects...

متن کامل

Single-Shot Object Detection with Enriched Semantics

We propose a novel single shot object detection network named Detection with Enriched Semantics (DES). Our motivation is to enrich the semantics of object detection features within a typical deep detector, by a semantic segmentation branch and a global activation module. The segmentation branch is supervised by weak segmentation ground-truth, i.e., no extra annotation is required. In conjunctio...

متن کامل

Functional Object Class Detection Based on Learned Affordance Cues

Current approaches to visual object class detection mainly focus on the recognition of basic level categories, such as cars, motorbikes, mugs and bottles. Although these approaches have demonstrated impressive performance in terms of recognition, their restriction to these categories seems inadequate in the context of embodied, cognitive agents. Here, distinguishing objects according to functio...

متن کامل

The Object Detection Efficiency in Synthetic Aperture Radar Systems

The main purpose of this paper is to develop the method of characteristic functions for calculating the detection characteristics in the case of the object surrounded by rough surfaces. This method is to be implemented in synthetic aperture radar (SAR) systems using optimal resolution algorithms. By applying the specified technique, the expressions have been obtained for the false alarm and cor...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: International Journal of Computer Vision

سال: 2022

ISSN: ['0920-5691', '1573-1405']

DOI: https://doi.org/10.1007/s11263-022-01642-4